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ABSTRACT 

A fully  symmetric  duality  model  is  presented  which  subsumes 
the  classical  treatments  given  by  Duffin  (1956),  Eisenberg  (1961) 
and  Cottle  (1963)  for  linear,  homogeneous  and  quadratic  convex 
programming.  A wide  variety  of  other  special  objective  functional 
structure,  including  positive  homogeneity  of  any  nonzero 
degree,  is  covered  as  well.  The  model  is  valid  in  spaces 
of  arbitrary  dimension  and  treats  explicitly  systems  of  both 
nonnegativity  and  linear  inequality  constraints,  where  the  partial 
orderings  correspond  to  nonpolyhedral  convex  cones.  The  approach 
is  based  on  augmenting  the  Fenchel-Rockafellar  duality  model 
(1951,  1967)  with  cone  structure  to  handle  constraint  systems 
of  the  type  mentioned.  The  many  results  and  insights  from 
Rockafellar ' s general  perturbational  duality  theory  can  thus  be 
brought  to  bear,  particularly  on  sensitivity  analysis  and  the 
interpretation  of  dual  variables.  Considerable  attention  is 
devoted  to  analysis  of  suboptimizations  occurring  in  the  model, 
and  the  model  is  shown  to  be  the  projection  of  another  model. 
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EXPLANATION 


The  paper  treats  optimization  problems  of  the  form  minimize 
f (x)  subject  to  the  side  conditions  x ^ 0 and  Ax  ]>  b,  where 
the  function  f is  convex  in  the  vector  variable  x,  the 
transformation  A is  linear,  and  the  inequality  relations  may 
be  determined  by  general  convex  cones.  An  essentially  equivalent, 
or  "dual",  formulation  of  this  problem  is  developed  which  reflects 
rather  explicitly  various  possible  structural  features  possessed 
by  f.  This  dual  problem  provides  the  theoretical  basis  for  an 
indirect  way  of  approaching  the  original  problem  computationally, 
and  in  particular  one  which  can  provide  lower  bounds  on  the  optimal 
value  sought.  A distinguishing  feature  of  the  duality  model,  or 
theory,  presented  here  is  that  the  alternate  problem  generated  by 
it  remains  within  the  same  qualitative  realm  of  difficulty  as  the 
given  problem.  The  paper  can  thus  be  viewed  as  a rather  broad 
extension  of  the  classical  theory  of  dual  linear  programs,  to 
cover  dual  pairs  of  nonlinear  convex  programs  sharing  the  same 
qualitative  level  of  difficulty. 


SYMMETRIC  DUALITY  FOR  STRUCTURED  CONVEX  PROGRAMS 
L.  McLinden 

1.  Introduction.  Consider  the  problem  of  minimizing  a function  f(x) 
subject  to  constraints  of  the  form  x _>  0 and  Ax  _>  b,  where  the  function 
f is  convex,  the  transformation  A is  linear,  and  the  partial  orderings 
are  determined  by  convex  cones.  Often  it  is  important  to  take  into  account 
the  sensitivity  of  this  problem  with  respect  to  small  changes  in  the  vector 
b.  In  addition  to  the  special  form  of  the  constraints,  the  function  f 
may  also  have  special  structure,  such  as  linearity,  quadraticity , positive 
homogeneity,  etc.  This  extra  structure  ought  usually  to  be  reflected 
rather  explicitly  in  dual  approaches  to  the  problem.  Further,  it  may  be 
essential  to  consider  such  an  optimization  problem  in  some  infinite  dimen- 
sional real  vector  space  rather  than  in  Rn,  and  to  regard  the  inequalities 
as  determined  by  order  cones  not  necessarily  finitely  generated. 

The  aim  of  this  paper  is  to  provide  a duality  model  which  deals  fully 
with  each  of  the  above  considerations,  and  which  is  also  symmetric,  in 
the  sense  that  the  dual  problem  generated  will  enjoy  structural  character- 
istics of  the  same  qualitative  type  as  the  original  problem.  The  goal  of 
such  symmetry  is  motivated  not  simply  by  aesthetics  or  by  the  proof- 
theoretic  power  which  it  provides,  but  mainly  by  its  algorithmic  implica- 
tions. By  symmetry  one  is  guaranteed  in  advance  that  the  character  of 
the  dual  problem  given  by  the  model  will  be  qualitatively  no  worse  than  the 
original  problem. 

In  1956,  R.  J.  Duffin  [3]  gave  such  a model  to  handle  the  fundamental 
case  of  f linear,  though  it  was  not  apparent  at  that  time  just  what  the 
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connection  with  sensitivity  was.  Duff in's  model  is  the  natural,  infinite 
dimensional  extension  of  the  celebrated  Gale-Kuhn-Tucker  [6]  symmetric 
treatment  of  linear  programming  duality.  Working  in  finite  dimensions 
and  using  polyhedral  order  cones,  E.  Eisenberg  [4]  in  1961,  and  R.  W.  Cottle 
[2]  in  1963,  gave  symmetric  duality  models  for  the  basic  nonlinear  cases 
of  f positively  homogeneous  and  quadratic,  respectively.  The  case  of  a 
positive  definite  quadratic  functional  in  Hilbert  space  occurs  very 
implicitly  in  a 1965  paper  by  J.-J.  Moreau  [12],  although  there  the  concern 
is  not  with  constraints  per  se.  In  1967,  R.  T.  Rockafellar  [17]  provided 
a symmetric  duality  treatment  for  completely  general  convex  optimization 
problems,  by  broadening  and  extending  the  finite  dimensional  model  presented 
by  W.  Eenchel  [5]  in  1951.  It  was  here  that  the  issue  of  sensitivity 
under  perturbations  was  first  dealt  with  and  its  intimate  connection  with 
the  dual  problem  explored.  Constraints  were  covered,  but  only  implicitly, 
by  the  presence  of  extended-real-valued  functions  and  a highly  useful 
linear  transformation.  In  1967  also,  Rockafellar  presented  the  outlines 
of  his  subsequent  extremely  broad,  and  symmetric,  perturbational  duality 
theory  for  convex  optimization  problems.  Details  of  this,  a wide  variety 
of  applications,  and  further  references  may  be  found  in  [20]. 

In  the  present  paper,  the  basic  Fenchel-Rockaf ellar  model  is  augmented 
with  explicit  cone  structure,  so  as  to  handle  directly  general  constraint 
systems  of  the  form  x _>  0 and  Ax  > b.  This  is  done  in  a manner  which 
maintains  the  complete  symmetry  of  the  original  model.  The  resulting 
framework  forms  a direct  bridge,  as  it  were,  between  the  Fenchel-Rockafellar 
model  for  general  convex  problems,  on  the  one  hand,  and  the  treatments 
given  by  Duffin,  Eisenberg,  and  Cottle  for  the  particular  classes  of 
linear,  homogeneous,  and  quadratic  problems,  on  the  other  hand.  We 
indicate  how  these  cases,  as  well  as  many  other  classes  of  problems  having 


special  structure,  can  be  handled  in  the  present  framework.  This  requires 
providing  conjugacy  and  subdifferential  formulas  for  various  special 
functional  structures  of  interest.  This  we  do  for  two  -oad  classes  of 


functions.  One  consists  of  generalized,  convex  "distance"  functions: 
Minkowski  gauge  functionals  composed  with  Young's  functions  on  the  half- 
line.  The  other  class  is  the  natural,  concave  analogue,  consisting  of 
what  might  be  viewed  as  generalized,  concave  "utility"  functions.  Taken 
together,  the  two  classes  include,  in  particular,  positive  homogeneity 
structure  of  any  nonzero  degree.  The  Lagrangian  minimax  problem  associated 
with  our  primal  and  dual  problems  has  explicit  "nonnegativity"  constraints 
in  each  of  the  two  arguments.  (Additional,  implicit  constraints  might 
also  be  built  in  via  the  extended-real-valued  saddle  function.)  The  present 
results  can  thus  also  be  interpreted  as  bearing  on  such  constrained  two- 
person  zero-sum  games. 

A topical  outline  follows.  In  §2  notation  is  established  and  the 
Fenchel-Rockaf ellar  model  recalled  briefly.  In  §3  a simple  principle  is 
observed  for  introducing  further  structure  into  the  problem  in  a symmetric 
fashion.  Based  on  this,  the  three  problems  forming  our  cone-augmented 
model  are  presented.  It  is  indicated  here  how  the  various  classical 
models  can  be  recaptured  from  the  present  one.  In  §4  the  main  results 
relating  the  primal  and  dual  problems  are  developed,  and  the  issue  of 
suboptimization  partially  addressed.  In  §5  the  extremality  conditions 
and  the  associated  minimax  problem  are  treated,  and  the  issue  of  sub- 
optimization  analyzed  further.  It  is  shown,  in  particular,  that  the  trio 
of  problems  being  treated,  regarded  both  collectively  and  individually, 
can  rightly  be  viewed  as  the  projection  of  another  trio  having  no  sub- 
optimizations  but  "twice  as  many"  variables.  In  §6  the  projection 
phenomenon  is  analyzed  further  and  seen  to  be  actually  quite  a general 
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"construction",  suggesting  further  issues  for  investigation.  In  §7 
conjugacy  and  subdifferential  formulas  are  indicated  for  the  generalized 
convex  distance  and  concave  utility  functions  mentioned  above,  enabling 
such  functions  to  be  employed  freely  in  the  model.  In  §8  are  some 
concluding  remarks  about  possible  variations  and  refinements  in  the  present 
framework . 

Although  the  thrust  of  the  present  paper  is  towards  (possibly  infinite) 
linear  inequality  constraint  systems  over  cones,  we  should  mention  that 
a symmetrized  duality  model  is  also  available  for  constraint  systems 
consisting  of  finitely  many  convex  inequalities.  This  was  first  presented 
by  E.  L.  Peterson  in  1972  for  closed  problems  in  the  finite  dimensional 
setting  [14,15],  and  has  recently  been  broadened  by  McLinden  [11]  to  cover 
nonclosed  problems  in  general  spaces,  as  well  as  polyhedral  refinements  in 
the  finite-dimensional  case.  In  that  model,  too,  symmetr ization  is  seen 
to  be  intimately  tied  to  suboptimizations.  On  this  point  those  papers 
serve  as  a useful  complement  to  the  present  one. 

To  highlight  the  many  symmetries  appearing  throughout,  we  work  in  the 
setting  of  locally  convex  real  topological  vector  spaces  paired  in  duality 
(see,  e.g. , [1]  or  [7]).  Readers  unfamiliar  with  this  setting  may,  for 

convenience,  interpret  all  spaces  as  Euclidean  with  the  usual  topology, 
or  reflexive  Banach  under  the  norm  topologies.  We  use  freely  standard 
facts  from  the  theory  of  conjugate  convex  functions  (see,  e.g.,  Moreau  [13] 
or  Rockafellar  [18,20]),  and  also  general  facts  about  perturbational 
duality  theory  contained  in  Rockafellar  [20] . 
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2.  The  basic  Fenchel-Rockaf el lar  model.  This  involves  the  following 


ingredients : 


[-oo,+co] 


3h 


* 


Here  X and  V are  locally  convex  Hausdorff  topological  vector  spaces 
over  the  real  numbers  R and  are  paired  in  duality  by  a real  bilinear 
form  (x,v)  ■*  <x,v>.  The  situation  is  analogous  for  the  spaces  U and  Y. 

The  functions  h and  k are  extended-real-valued  convex  and  concave, 

★ ★ 

respectively,  and  h and  k are  the  functions  conjugate  to  them  under 
the  Fenchel  transform  (in  the  convex  and  concave  sense,  respectively). 

1c  + 

The  transformations  3h  and  3k  are  the  subdifferentials  of  h and  k , 
respectively.  They  send  points  into  closed  convex  sets  and  are  generaliza- 
tions of  gradient  mappings,  to  which  they  reduce  in  the  presence  of 

differentiability.  The  transformation  A is  linear  and  continuous  with 

* 

adjoint  A . 

The  model  is  designed  to  treat  the  initial  problem  of  interest,  the 
primal  problem 

min(h(x)  - k(Ax))  , (P_) 

x 

by  means  of  its  close  interrelationships  with  two  other  optimization 
problems:  the  dual  problem 

max{k  (y)  - h (Ay)}  , [DQ) 

y 

and  the  Lagrangian  problem 
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The  variables  in  (£g)  are  restricted  to  lie  in  the  product  set  dom  h x dom  k*. 
It  is  helpful  to  think  of  (Lg)  as  a sort  of  bridge  linking  (Pg)  with  (Dg) ■ 
Throughout  the  paper  we  make  the  nondegeneracy  assumption  that  the 
lower  semicontinuous  hull  of  h is  finite  somewhere  and  the  upper  semi- 
continuous  hull  of  k is  finite  somewhere.  (In  the  Euclidean  case  this  is 
satisfied  if  h and  k are  merely  proper  convex  and  proper  concave,  respec- 
tively.) This  implies  that  h,  k,  h , k are  proper  and  moreover  satisfy 

* * * * 

lsc  h = cl  h = h , use  k = cl  k = k 

From  the  properness,  note  that  the  extended  arithmetic  in  (Pg) , (Dg),  and  (Pg) 

never  involves  adding  -°°  to  +°°. 

* 

The  subdifferentials  3h,  3k  serve  as  vehicles  for  expressing  the 
extremality  conditions,  or  abstract  Kuhn-Tucker  conditions,  associated 
with  this  trio  of  problems: 

Ax  e 3k  (y) , Aye  3h(x)  . 

A pair  (x,y)  satisfies  these  conditions  if  and  only  if  it  solves  (2,^ ) , in 
which  case  x solves  (Pg) , y solves  (Pg) , and  all  three  optimal  values 
coincide.  Conversely,  under  any  of  a variety  of  hypotheses  ("constraint 
qualifications"),  in  order  that  a vector  x solve  (PQ),  it  is  necessary  that 
there  exists  a vector  y such  that  (x,y)  satisfies  the  Kuhn-Tucker  conditions. 

An  important  feature  of  the  model  is  its  relevance  to  sensitivity 
analysis.  Briefly,  the  function  being  optimized  in  (Pg)  precisely  mirrors 
the  sensitivity  of  (Pg)  with  respect  to  a certain  class  of  perturbations, 
which  here  correspond  to  "horizontal"  translations  of  the  graph  of  k. 

This  relationship  between  primal  sensitivity  and  the  dual  problem  was 
first  observed  in  [17]  and  is  explicated  thoroughly  in  [18,20],  Details 
of  this,  as  well  as  other  general  relationships  concerning  the  three 
problems  just  introduced,  may  also  be  obtained  by  appropriate  specializa- 
tion of  the  cone-augmented  version  of  the  model  which  follows. 
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3.  The  underlying  idea  and  the  cone-augmented  model.  Our  method  of 
obtaining  symmetry  is  based  on  a very  simpie  idea.  The  idea  is  also  quite 
natural,  in  view  of  the  basic  properties  of  the  Fenchel  transform. 

We  proceed  in  a quasi-formal  manner,  introducing  two  nonempty  families, 

A and  b,  of  extended-real-valued  functions.  The  members  of  A are 
required  to  be  convex  with  lower  semicontinuous  hull  somewhere  finite, 
and  those  of  B are  required  to  be  concave  with  upper  semicontinuous  hull 
somewhere  finite.  These  families  will  serve  to  single  out  special  types 
of  problem  structure  such  as  linearity,  quadraticity , and  even  cone 
constraint  structure,  as  we  shall  see  shortly.  When  the  functions  h and 
k in  (Pg)  satisfy  h c A and  k e B,  we  say  (Pp)  is  of  type  ( A,B ). 

For  symmetry,  conditions  are  needed  which  will  imply  that  ( DQ ) is  of  the 

same  type  as  (P  ),  up  to  closures  and  minus  signs.  Clearly,  the  above 

* * * * 

restrictions  on  h and  k imply  that  h £ A and  k e B , where  the 

* 

notation  C denotes  the  family  obtained  from  C by  forming  the  conjugates 
(in  the  appropriate  sense)  of  the  members  of  C.  (Similarly  for  the  nota- 
tion cl C and  -C  to  follow.)  Since  this  means  that  (Op)  is  of  type 

* * 

( B ,A  ) , the  conditions  needed  to  ensure  that  (Dp)  is  of  the  same  type 
as  (Pp)  are  simply  that  A and  B satisfy 

A = -cl  B and  B = -cl  A . (3.1) 

Jn  this  terminology,  the  general  Fenchel-Rockaf ellar  problems  (Pp)  and 
(V p)  are  each  of  type  (A,B)  for  the  largest  possible  choices  of  A and 
B,  namely  B = -4 , where  A is  the  family  of  all  convex  functions  having 
lower  semicontinuous  hull  somewhere  finite.  With  this  choice,  conditions 
(3.1)  follow  immediately  from  the  basic  properties  of  the  Fenchel  transform. 

We  shall  see  below,  in  terms  of  the  cone-augmented  model,  how  other,  more 
special  choices  of  the  families  A and  B yield  symmetric  duals  having 
specific  structure. 


We  now  apply  the  above  idea  to  see  how  to  handle  in  a symmetric 
fashion  systems  of  both  nonnegativity  and  linear  inequality  constraints 
over  cones.  Consider,  for  example,  the  problem  posed  at  the  beginning  of 


the  Introduction,  namely,  to  minimize  f(x)  subject  to  x e P and 
Ax  - b e Q,  where  P and  Q are  nonempty  convex  cones  determining  the 
orderings.  This  can  be  cast  as  (P  ) by  letting  h = f + ipp  and  k = “'•'q+j3- 
(We  write  ip^  to  denote  the  convex  indicator  of  a convex  set  C.)  Notice 
that  incorporating  the  constraint  Ax  >_  b into  the  k(Ax)  term  of  (P^) 
ensures  that  the  dual  problem  will  yield  information  on  the  particular 
sensitivity  in  (P^)  of  interest  to  us,  namely  the  effects  of  perturbing 
the  right-hand-side  vector  b by  small  amounts  (cf.  remark  concerning 
sensitivity  at  the  end  of  §2).  Now  how  can  the  preceding  (A , B)  - develop- 
ment be  brought  to  bear,  at  least  heuristically?  Since  h is  of  the  form 
h = h^  + let  us  take  for  A all  the  convex  functions  "having  this 

form."  Then  the  elements  of  A have  the  form  of  h* = cl (h*  □ h^), 
under  suitable  circumstances,  where  the  symbol  □ denotes  the  operation  of 
infimal  convolution  on  convex  functions.  In  view  of  the  ^irst  requirement  in 
(3.1),  this  suggests  choosing  for  B all  concave  functions  k of  the  form 

k = k^  D where  here  the  symbol  □ denotes  the  operation  of  supremal 

* 

convolution  on  concave  functions.  The  members  of  B then  look  like 

* * * 

k = k^  + k^,  so  that,  again  under  suitable  conditions,  the  other  requirement 
in  (3.1)  is  met.  Now  consider  what  happens  when  h2  is  of  the  special  form 

it  o 

h 2 = '('p  for  a convex  cone  P.  The  fact  that  h2  = ’f’por  where  P is  the 
polar  cone,  suggests  taking  k2  (in  the  elements  of  B)  to  be  of  the  special 

form  k2  = for  some  convex  cone  Q.  This,  of  course,  yields 

* * 

k2  = -i|>qo(--)  = -ip  * , where  Q is  the  dual  cone  (i.e.  negative  of  the  polar). 

This  outlines  a rather  general  scheme,  in  which  the  three  optimization 
problems  assume  the  form 
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(k^  □ k2) (Ax) ) , 


(3.2) 


min{ (h^  + h2) (x) 
x 

max{  (k^  + k2>  (y) 
V 


(h*  □ h*)  (A*y ) ) , 


(3.3) 


and 

minimaxf (h.  + h_) (x)  + (k*  + k*)(y)  - <Ax,y>}  , (3.4) 

x y 1 

* * 

and  the  functions  h2,  k2,  h2,  k2  can  be  restricted  to  be  the  indicators 
of  certain  cones.  Of  course,  all  this  is  only  heuristic,  since  the  above 
"derivation"  glossed  over  key  technical  issues  in  several  places.  It 
does,  however,  serve  to  illuminate  the  origin  of  the  cone-augmented  model 
below. 

To  clarify  further,  consider  once  more  the  problem  from  the  Introduc- 
tion. We  can  apply  the  above  scheme  to  it  by  choosing  h^  = f,  h2  = \p  , 
k2  = ~^Q ' In  vieW  of  (_^Jb)  n = -^Q+b'  Problem  (3.2) 

is  then  just 


min  (f  (x) } , 
x >0 , Ax>Jd 

and  its  "dual"  problem  should  be  something  like  that  given  by  (3.3),  i.e. 
max(  (<  b ,y  > - ip  *(y))  - (f*  □ <Pp°  ) (A*y)  } . 

y Q 


By  drawing  the  inf-convolution  to  the  outside,  this  can  be  rewritten  as 

a 

f * 

max  sup  (<b,y>  - f (v)  } (to  find  y only)  , 
y^O  v^A  v 

where  the  partial  orders  are  the  natural  ones  induced  on  V and  Y by 

* * 

P and  Q . The  associated  minimax  problem  ought  to  be  (3.4),  i.e. 

minimax{f(x)  + <b,y>  - <Ax,y>}  . 
x>0  y>_0 

Notice  in  the  "dual"  the  appearance  of  a suboptimization  over  an  auxiliary 
variable  v.  This  reflects  the  fact  that  the  original,  primal  problem 
we  started  with  is  actually  asymmetric  in  a certain  sense  having  to  do 
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with  the  particular  class  of  perturbations  involved.  The  statements  of 
all  the  results  below  can  easily  be  specialized  to  such  asymmetric  cases. 

Now  let  nonempty  convex  cones  P c x and  Q C U be  given  and  fixed, 
once  and  for  all,  and  let  h,  k,  and  A be  as  in  the  beainning  of  §2.  The 
cone-augmented  extension  of  the  Fenchel-Rockaf el lar  model  which  we  shall 
study  consists  of  problems  (3.2),  (3.3)  and  (3.4),  where 

hi  = h'  h2  = V kl  = k'  k2  = -’"q  • 


Thus,  our  primal  problem  is 

mini  (h  + (p  ) (x)  - (k  □— «p_)  (Ax)  } , 

x u 

which,  by  drawing  the  sup-convolution  to  the  outside,  can  be  rewritten  as 

min  inf  ih(x)  - k(z) } (to  find  x only)  . (p) 

x>0  Ax>z 

Our  dual  problem  is 

max { (k*  - \p  *)  (y)  - (h*  □ ip  „)(A*y)  } , 

y Q 


which,  by  drawing  the  inf-convolution  to  the  outside,  can  be  rewritten  as 

* * 

max  sup  {k  (y)  - h (w)  } (to  find  y only)  . (D) 

y>0  w>A *y 

The  associated  Lagrangian  saddl epoint  problem  is 

★ 

minimaxih(x)  + k (y)  - <Ax,y>}  , (£) 

xc  C ye  D 


where 

C = P n dom  h,  D = Q*  n aom  k*  . (3.5) 

Notice  first  of  all  that  with  the  choices  P = X and  Q = {0}  these 
three  problems  coincide  exactly  with  the  problems  (Pq) , (Dq) , and  (Lq) 

’reated  by  the  Fenchel-Rockaf ellar  model.  The  various  hypotheses  we 
shall  invoke  in  §§4,5  in  proving  results  for  the  cone-augmented  model  all 
reduce,  for  this  particular  choice  of  cones,  to  the  "standard"  conditions 
required  in  the  original  Fenchel-Rockaf el lar  model. 
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Next,  notice  that  Duffin's  model  r<  .ults  when  the  cone-augmented 


1 

★ 

model  is  restricted  to  problems  (P)  of  type  (A,B),  where  B — -A  and  A 

consists  of  all  continuous  linear  functions.  This  follows  from  the  fact 
that  the  (convex)  conjugate  of  a function  of  the  form  x -♦  <x,a)  has  the 
form  v ■*  ^ ( v ) . Thus,  if  we  take  h and  k to  be  of  the  form 

a 

h(x)  = (x,c>  and  k (u)  = -^(u),  then  the  three  problems  assume  the 
special  form 

min  {<  x , c > ) , 

xj^O , Ax>b 

max  * {(  b,y  >}  , 
y>c,c^h  y 

and 

minimaxH  x,  c ) + <b,y>  - <Ax,y>)  . 
x^O  y^O 

The  above  two  cases  can  be  regarded  as  the  "extreme"  cases  of  the 
cone-augmented  model.  They  are  the  only  cases  in  which  the  suboptimiza- 
tions "disappear"  from  both  ( P ) and  (D) . 

Symmetric  duality  for  various  types  of  nonlinear  objective  functional 
structure  can  be  obtained  by  using  the  conjugacy  (and  subdifferential) 
formulas,  presented  in  §7,  together  with  the  results  in  §§4,5  for  (P)  , 

(0)  and  (£) . For  example,  Eisenberg's  treatment  of  the  homogeneous  case 

is  extended  by  considering  those  problems  (P)  of  type  (A,B),  where 

* 

B = -A  and  A is  chosen  to  be  the  family  of  (closed)  gauge  functionals. 

Corollary  13B  in  §7  provides  the  essential  facts  for  this.  As  another 

example,  Cottle's  treatment  of  the  quadratic  case  is  extended  by  consider- 

* 

ing  those  problems  (P)  of  type  (A,B),  where  again  B = -A  but  this 

time  A is  chosen  to  be  the  family  of  all  functionals  of  the  form 
1 2 

x -*■  ' where  yc  is  the  closed  gauge  associated  with  a "polar"  set 

C.  Convex  quadratic  forms,  or  more  generally,  p*'*1  powers  of  norms,  can  be  re- 
presented by  the  appropriate  specification  of  C.  The  essential  conjugacy  (and 
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* 


subdifferential)  formulas  are  provided  by  Corollary  13A  of  §7.  A number 
of  other  interesting  objective  functional  structures  likewise  admit 
symmetric  duality  treatment  with  the  aid  of  Propositions  13  and/or  14  of 
§7,  combined  with  the  results  which  follow  in  §§4,5. 


I 


'i 
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< (x,u) , (v,y)>  -»  <x,v>  + <u,y>.)  These  can  be  reformulated  as 


F(x,u) 


G(y,v) 


inf  (h(x)  - k(z)}  if  x ^ 0 
Ax+u^z 

+ 00  otherwise  , 

sup  (k  (y)  - h (w)  } if  y ^ 0 
w>A*y+v 


In  terms  of  these  functions,  the  problems  (P)  , (P)  and  (L)  can  be  expressed 


as 


and 


min  F(x,0)  , 
x 

max  G(y,0)  , 

y 


minimax  K(x,y) 
x y 


In  view  of  the  similarity  in  notation  between  the  above  and  the 
development  in  [20],  it  would  appear  that  we  can  apply  the  results  from 
there  immediately.  That  would  be  incorrect,  however,  as  it  has  not  been 
established  that  the  present  functions  F,  G and  K bear  the  same 
relationships  to  each  other  as  do  Rockafellar ' s corresponding  three  func- 
tions. The  relationships  among  F,  G and  K presumed  by  the  development 
in  [20]  all  stem  from  two  key  identities: 


and 


G(y,v)  = -F  ( v, -y ) 


K(x,y)  = inf  [F  (x , u)  + <u,y>] 
u 


(4.1) 


(4.2) 


(cf.  [20,  equations  (4.17)  and  (4.2)]). 

It  is  easy  to  see  that  one  of  these,  (4.2),  holds  here  without  any 

additional  conditions.  Indeed,  from  our  definitions  of  F and  K it 

is  satisfied  trivially  when  x / C,  while  for  x e C we  can  compute  that 

inf(F(x,u)  + <u,y>}  = inf{(h  + ip  ) (x)  - (k  □-#>)( Ax  + u)  + <u,y>} 
u u y 

= (h  + ) (x)  + inf  { ( u,y ) - (k  □-([/  ) (Ax  + u)  } 


= (h  + i[/p)  (x)  + inf  {<  u'  ,y  > - (k  D-ty  )(u')}  - <Ax,y> 

u ' y 

= (h  + <l>  ) (x)  + (k  - <l>  *)  (y)  - <Ax,y>  . 

Q 
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The  identity  (4.1)  is  a more  delicate  matter.  In  general,  the  best 
one  can  obtain  is  the  inequality  in  Proposition  1 below.  For  it,  and 
for  the  remainder  of  the  paper,  it  is  convenient  to  make  the  following 
nondeqeneracy  assumption: 


C * $ and  D * . 


(4.3) 


This  simply  has  the  effect  of  eliminating  from  the  discussion  certain 
trivial  situations  which  would  be  awkward  always  to  carry  along.  It  can 
be  shown  that  D = 4>  if  and  only  if  the  function  usc(kD  - i^)  is  + .<» 
throughout  the  set  cl(dom  k + Q) . 

PROPOSITION  1.  The  functions  F and  G satisfy 

G(y,v)  £ -F*  (v, -y ) 


F(x,u)  •>  -G  (u,-x)  . 

Furthermore,  F is  proper  convex  with  lsc  F never  - and  G is 
proper  concave  with  use  G never  + °°. 

PROOF.  We  give  the  proof  for  the  second  inequality  only,  as  the  proof 

of  the  first  one  is  quite  similar.  Computation  yields  that 

* 

-G  (u,-x)  = -inf {<  ( u , -x ) , (y , v)  > - G(y,v) } 
y- v 

= sup{-<  u,y  ) + ( x , v ) + G (y , v) } 
y,v 

= sup  sup{-<  u,y  > + < , v > + (k  * - ^ * ) (y ) - (h*  □ ) (A*y  + v)  } 

yf  D v Q p 

= sup{  (k*  - *)  (y)  - <u,y>  + a(x,y)}  , 

yep  Q 


where 


a(x,y)  = sup(<x,v>  - (h  □ ^p°  ) (A*y  + v)  } 
v 

= sup  { < x , v 1 ) - (h*  a lb,  ) (v1 ) ) - < x , A*y  > 
v ' 

= (h  □ V'po  ) (x)  - <x,A  y> 

* * It 

- (h  + i)'po  «)(x)  - < x , A y > . 


If  x / C,  then  F(x,u)  = +“  and  the  desired  inequality  is  satisfied 

trivially.  If  x f C,  then  a(x,y)  is  finite  and  we  have 

* * * * * 


(h 

<P po  0 ) ,x)  + s up { (k 

- ij»  *)  (y)  - < u,y  > - < x,A 

ye  D 

0 

* * 

* 

(h 

+ 

ippo  0 ) (x)  - inf  (<  Ax 
ye  D 

+ u,y  > - (k  - *)  (y)  } 

0 

* * 

* 

★ 

(h 

+ 

^ p°  0 ) (x)  - (k  - t|> 

*)  (Ax  + u)  . 

* * it  it 

Since  h + ijj^><.<^h  + and  (k  - tp  * ) k □-!//_,  the  desired  inequality 

P Q 

follows.  Next,  we  claim  that  G cannot  be  identically  - «■  . Indeed, 

* 

D * <t>  implies  that  G = - °°  if  and  only  if  h Q = + °°  , which 

■k  _ 

happens  if  and  only  if  h = +<*>.  But  the  latter  cannot  occur,  because 

lsc  h is  assumed  finite  somewhere.  Now  since  G £ - , the  first 

★ 

inequality  implies  that  F £ + 00  , from  which  it  follows  that  lsc  F is 
never  - «°  . In  a similar  way,  using  C * Q , one  shows  that  F £ + <*>  . 

From  this  and  the  second  inequality  it  follows  that  G*  £ - <*>  , so  that 
use  G is  never  + 00  . Finally,  F is  proper  because  of 

- <*>  < lsc  F < F £ + 00  t 

and  G is  proper  because  of 

- <»  fc  G < use  G < + * 

COROLLARY  1A.  One  always  has  the  estimate 

P (x , 0)  > G (y , 0 ) . 

Moreover,  equality  is  attained  by  a pair  of  vectors  x and  y if  and 
only  if  x solves  (P) , y solves  (P) , and  min  ( P ) - max  (P)  . 

PROOF.  From  either  of  the  inequalities  established  in  the  proposition, 
one  can  obtain  the  general  inequality 

F ( x , u ) - < x,v > > G(y,v)  - < u,y  > . 

The  corollary  follows  by  specializing  this  to  the  case  u = 0,  v = 0. 

The  inequalities  in  Proposition  1 say  that  F and  G are  always 
subcon jugatos  of  one  another  (up  to  minus  signs) , and  thus  one  can  always 
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view  (P)  and  (P)  as  subduals  of  each  other.  But  in  general  ( D ) will  not 


furnish  as  tight  a lower  bound  on  (P)  as  one  would  hope  for,  unless  the 
identity  (4.1)  is  satisfied.  In  addition,  most  of  the  nicest  duality 
relationships  between  (P)  and  (0)  require  that  the  function  F(x,u)  be 
closed  in  the  u argument  at  least,  and  some  even  require  F to  be 
closed  in  (x,u)  jointly  (cf.  [20]).  As  the  next  proposition  shows,  these 
types  of  regularity  depend  on  the  following  condition's  being  met: 

(h  + 1(1  p)  = h*  □ <l>p  0 (//1) 

or 

(k*  - *)*  = k D-ij«  . (H  ) 

Q 

In  the  case  of  the  basic  Fenchel-Rockafellar  model  (i.e.  P = X and 
Q = { 0 } ) , the  first  of  these  is  met  trivially,  while  the  second  amounts 
simply  to  having  k closed.  A similar  remark  applies  to  conditions  (P|) 
and  (//V)  used  in  §5.  Proposition  8 at  the  end  of  this  section  furnishes 
a number  of  conditions  implying  (P^),  as  well  as  the  (P^)  and  (PV)  occurring 
later  on,  in  the  case  where  the  order  cone  structure  is  nontrivial. 

PROPOSITION  2.  If  (P^)  holds,  then  G is  closed  (jointly)  and 
satisfies  the  identity 

G(y,v)  = -F* ( v, -y ) . (4.1) 

If  (P^)  holds,  then  F(x,u)  is  closed  in  u for  each  x,  and  if  in  addition 
h and  P are  closed,  then  F is  closed  (jointly)  and  satisfies 

F(x,u)  = -G  ( u , — x ) . 

PROOF.  We  prove  only  the  latter  two  assertions,  as  the  proof  of  the 
first  assertion  is  similar.  If  x / C,  then  F(x,-)  s + » , which  is 
trivially  closed.  If  x e C,  then  (h  + i|ip)  (x)  is  finite,  and  so  the 
closedness  of  F(x,-)  is  equivalent  to  that  of  (k  D-Vq)  • But  this  func- 

tion is  closed,  since  by  the  assumption  (P it  is  a conjugate  function. 

To  prove  F is  closed  jointly,  it  suffices  to  establish  the  identity, 
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since  that  exhibits  F as  a conjugate  function.  The  identity  itself 
follows  from  an  examination  of  the  proof  of  the  corresponding  inequality 


in  Proposition  1.  Indeed,  if  h and  ipp  are  closed,  then 

* It 

h + i(/p.  o = h + ijip,  and  from  this  it  follows  that 

-G  (u,-x)  = + <*>  = F (x , u ) , Vx  / C , 

and 

-G  (u,-x)  = (h  + ) (x)  - (k  - i|i  *)  (Ax  + u)  , Vx  c C . 

Q 

Under  the  hypothesis  {H^) , the  desired  identity  then  follows. 

COROLLARY  2A . If  (11^  holds,  then 

G (y  , v)  = inf  (K  (x  , y ) - <x,v>}  , 
x 

and  so  in  particular 

sup(D)  = sup  inf (L)  . 

If  (Z^)  holds,  then 

F (x , u)  = sup{K(x,y)  - < u , y > } , 

y 

and  so  in  particular 

inf(i’)  = inf  sup  (A)  . 

PROOF.  If  (Z/^)  holds,  then  the  proposition  yields  (4.1).  But  also 

-F  (v , -y)  = inf{F(x,u)  - <x,v>  + <u,y)} 
x,u 

= inf{inf (F(x,u)  + <u,y>)  - <x,v>) 

X u 

= inf (K(x,y)  - < x,v>) 
x 

by  (4.2).  This  establishes  the  first  identity.  Next,  observe  (4.2)  can 
be  rewritten  as 

K (x,y)  = -F (x, * ) * (-y ) , 

and  so 
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sup{  K ( x , y ) - < u , y > } = sup{-F  (x,  • ) ( — y ) - <u,y>) 

y y 

* 

= sup{<  u , -y  ) - F (x , • ) (-y) } 

y 

= F(x,.)**(u) 

Since  the  last  expression  equals  F(x,u)  when  F(x,*)  is  closed,  we  are 
done  by  the  proposition  when  (W holds. 

In  view  of  Proposition  2,  we  are  in  a position  to  harvest  immediately 
from  [20]  five  additional  propositions  containing  a great  deal  of  informa- 
tion concerning  our  trio  of  problems.  These  could,  of  course,  be  established 
"from  scratch",  working  directly  with  the  model's  ingredients  h,  k,  P,  Q 
and  A,  but  that  would  serve  little  purpose  besides  lengthening  the  paper. 

The  first  of  these  provides  a great  deal  of  information  concerning  the 
precise  relationship  between  ( P ) and  ( D ) . It  relates  the  optimal  value 
function  in  one  problem  to  the  objective  function  in  the  other  problem. 

The  primal  objective  function  is 

{inf{h(x)  - k(z) |Ax  > z)  if  x f C 
+ “ if  x / C , 

the  dual  objective  function  is 

s k k k 

sup{k  (y)  - h (w)  [w  >_  A y}  if  y e D 
- “>  if  y / D , 

the  pr ima 1 optima  1 value  function  is 


g(y)  = g (y , 0) 


•f  (u)  = inf  F (x,u) 
x 


inf(h(x)  - k(z) |x  > 0,  Ax  + u > z)  , 


(4.4) 


and  the  dual  optimal  value  function  is 

* * k 

Y(v)  = sup  G(y,v)  = suplk  (y)  - h (w)  |y  ^ 0,  w A y + v} 

y 


(4.5) 


Notice  that 


dom  = dom  k + Q - AC  * $ 


and 


* * * 

dom  v = dom  h - P - A D * 
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where  the  nonemptiness  follows  from  the  nondegeneracy  assumption  (4.3). 

PROPOSITION  3.  (a)  Assume  (tf  ) holds.  Then 

* * 

g = (-s? ) and  -g  = cl  <?  . 

In  particular, 

supvP)  = 1 im  inf  v?(u)  , (4.6) 

u-*0 

except  in  the  case  where  0 / cl  dom  •?  and  the  function  lsc  is  nowhere 

finite.  (In  the  exceptional  case,  sup(D)  is  - °°  , while  the  limit  is 

+ " and  lsc  = - <*>  on  dom  lsc  ^ = cl  dom  v . ) 

(b)  Assume  (H 2)  holds  and  that  h and  P are  closed.  Then 

* * 

f = (~y)  and  -f  = cl  y • 

In  particular, 

inf (P)  = lim  sup  y ( v ) » (4.7) 

v-0 

except  in  the  case  where  0 / cl  dom  y and  the  function  use  y is  nowhere 

finite.  (In  the  exceptional  case,  inf (P)  is  + °»  , while  the  limit  is 

and  use  y = + 00  on  dom  use  Y = cl  dom  y-) 

(c)  Assume  ( H and  (H^)  both  hold  and  that  h and  P are  closed. 

Then  both  (4.6)  and  (4.7)  hold,  except  in  the  degenerate  case  in  which 
all  of  the  following  properties  are  present: 


( 0 ) = + “ , 

lsc 

- - 00  on 

dom 

lsc 

<p  = cl 

dom 

<P  , 

Y ( 0 ) = —co  , 

use 

Y = + 00  on 

dom 

use 

Y = cl 

dom 

Y • 

PROOF.  Parts  (a)  and  (b)  follow  from  [20,  Theorems  7 and  7']»  together 
with  Proposition  2.  Part  (c)  then  follows  from  (a)  and  (b) , with  the  aid 
of  [20,  Theorem  4], 

The  next  result  involves  in  part  the  extremality  conditions  associated 
with  the  trio  (P) , (D) , (L) . By  virtue  of  the  saddlepoint  characterization 

of  them  which  obtains  "usually"  (i.e.  under  suitable  constraint  qualifica- 
tions) , they  can  be  introduced  as  the  abstract  Kuhn-Tucker  conditions: 
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> 


Mmm 


(0,0)  f 3K(x,y) 


(4.8) 


(cf.  [20,  page  39]).  The  pairs  (x,y)  satisfying  (4.8)  are  precisely  th 
saddlepoi nts  of  K,  i.e.  the  solutions  of  (L) . 

In  the  case  of  the  basic  Fenchel-Rockafellar  model,  the  Lagrangian 


sadk.it  function  is 

f h(x)  + k (y)  - (Ax,y>  if  x t dom  h 

(*,y>-  < 

“ if  x / dom  h , 

and  from  this  it  is  easy  to  see,  using  the  definitions,  that  conditions 

(4.8)  are  equivalent  to  the  conditions 

* * 

Ayr  3h(x)  and  Ax  e 3k  (y)  . i 


(4.10) 


Now  in  the  cone-augmented  model,  observe  that  the  Lagrangian  saddle  func- 
tion K coincides  with  what  one  obtains  by  substituting  h + i]i  and 
k in  Place  of  h and  k,  respectively,  in  (4.9).  It  follows  by 

simple  substitution  in  (4.10),  then,  that  the  Kuhn-Tucker  conditions  for 
the  cone-augmented  model  are  equivalent  to  the  conditions 

Ayt  3 (h  + if>  ) (x)  and  Axe  3 (k  - 0 *)  (y)  . 


Corollary  12A  in  §5  will  provide  a further  break-down  of  these  conditions. 
PROPOSITION  4.  If  (//^)  holds,  then  the  implications 


(a)  <=>  (b)  =>  (c)  =>  (d) 
hold  among  the  conditions: 

(a)  inf (P)  = sup ( D)  ; 

(b)  * (0)  =cl*  (0)  ; 

(c)  the  saddle  value  of  the  Lagrangian  K exists; 

(d)  y (0)  = cl  y (0)  . 

If  (//.)  holds,' then  (b)  and  (c)  are  equivalent.  If  both  (8,  ) and  (//„) 
^ 12 

hold  and  h,  k,  P,  Q are  all  closed,  then  (a),  (b) , (c) , (d)  are  all 

equivalent.  Furthermore,  if  ( //1 ) holds,  then  the  implication 

(e)  =>  (f) 


holds  between  the  following  conditions,  with  actual  equivalence  when  (Z/^) 


is  also  satisfied: 

(e)  x solves  (P) , y solves  (P) , and  inf (P)  = sup(P)  ; 

(f)  the  pair  (x,y)  satisfies  the  Kuhn-Tucker  conditions. 

PROOF.  By  (20,  Theorem  15],  together  with  Proposition  2. 

COROLLARY  4A.  Assume  [H  ^ ) holds  and  that  inf  (p)  = max (d)  (i.e., 

inf(P)  = sup(P)  and  there  actually  exists  a solution  to  Id))-  Then  a 
necessary  condition  in  order  that  x solve  (P)  is  that  there  exist  a y 
such  that  (x,y)  satisfies  the  Kuhn-Tucker  conditions.  This  condition 
is  also  sufficient  when  (/V^)  holds,  or  more  generally,  when 
F(x,0)  = cl  F(x,0)  . 

PROOF.  All  but  the  very  last  remark  follows  directly  from  the 
proposition.  The  sufficiency  under  the  assumption  F(x,0)  cl^F(x,0) 

follows  upon  a closer  examination  of  the  proof  of  [20,  Theorem  15]. 

PROPOSITION  5.  Assume  (//^)  holds.  Then  the  following  conditions  on 
a vector  y are  equivalent: 

(a)  y solves  (D)  and  inf (P)  = sup(P)  ; 

(b)  -y  e 3*  (0)  ; 

(c)  inf (P)  = inf  K(x,y)  . 

x 

PROOF.  By  (20,  Theorem  16],  together  with  Proposition  2. 

COROLLARY  5A . Assume  (Z^)  holds  and  that  *(0)  = inf (P)  is  finite. 
Then  the  following  are  equivalent: 

(a)  inf  (P)  = max(P)  ; 

(b)  lim  inf  ^'(0;u')  is  finite  for  some  u. 

u ' >-u 

PROOF.  By  the  equivalence  between  (a)  and  (b)  of  the  proposition, 
together  with  [20,  Theorems  11(b)  and  4]  applied  to  the  function 
6 (u)  = t ' (0;u)  . 
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PROPOSITION  6.  Assume  (W^)  holds  and  that  <c  is  bounded  above  on 
a neighborhood  of  0.  Then  each  of  the  following  holds: 

(a)  inf (P)  = max(P)  ; 

(b)  In  fact,  for  every  real  8 the  set  (y|g(y)  B)  is  closed, 
bounded  and  convex,  actually  equicontinuous  and  hence  weakly  compact 

(in  the  w’eak  topology  induced  on  Y by  U)  . Thus,  every  maximizing 
sequence  for  ( D ) has  weak  cluster  points,  and  every  such  cluster  point 
solves  (.0)  . 

(c)  If  the  optimal  value  (s)  in  (a)  are  not  - °°  , then 

*>'(0;u)  = max{(u,-y)|y  solves  (D)  } . 

(d)  A vector  y solves  (P)  uniquely  if  and  only  if  y = -Vv?(0), 
that  is, 

f ' ( 0 ; u ) = -(  u , y > , 

and  in  this  event  every  maximizing  sequence  for  (0)  converges  weakly  to  y. 

(e)  The  maximizing  sequences  for  (0)  all  actually  converge  in  the 
designated  topology  on  V if  and  only  if  y is  differentiable  at  0 
in  relation  to  that  topology. 

PROOF.  By  [20,  Theorem  17]  and  Proposition  2. 

PROPOSITION  7.  Each  of  the  following  conditions  is  sufficient  for 
to  be  bounded  above  on  a neighborhood  of  0 (and  hence  continuous  at  0)  : 

(a)  There  exists  an  x such  that  the  function  u -»  F(x,u)  is 
bounded  aoove  on  a neighborhood  of  0.  (Or  more  generally,  for  some 
continuous  mapping  0 : U -»  X the  function  u ->  F(9(u),u)  is  bounded 
above  on  a neighborhood  of  0.) 

(b)  U = Rn  = Y and  0 c core  dom  s?  (where  "core”  denotes  the 
algebraic  interior) . 

(c)  X and  U are  each  Banach  spaces  (in  the  designated  topologies) , 

0 c core  dom  v,  h and  P are  closed,  and  (H holds. 
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(d)  U - Rn  = Y,  at  least  one  of  the  level  sets  fy|g(y)  > 3)  is 
nonempty  and  bounded,  and  (//^)  holds. 

(e)  Both  (W^)  and  (11.^)  hold,  h and  P are  closed,  and  there 
exists  a neighborhood  N of  0 in  V and  a real  number  3 such  that 
the  set 

lyl'dv  e N,  G ( y , v)  > 3) 
is  nonempty  and  equicontinuous . 

PROOF.  By  (20,  Theorem  18]  and  Proposition  2.  Concerning  (c) , the 
fact  that  it  suffices  to  assume  just  that  X is  Banach,  rather  than  V, 
is  shown  in  [16,  Corollary  1]. 

COROLLARY  7A.  Suppose  that  condition  (e)  of  Proposition  7 holds, 
bvit  with  equicont  inuity  replaced  by  the  assumption  that  the  closure  of 

{y|dv  { N,  G (y , v)  > 3) 

is  weakly  compact.  Then  g is  bounded  above  in  a neighborhood  of  0 rela- 
tive to  the  Mackey  topology  on  U,  and  hence  all  the  conclusions  of 
Proposition  6 are  valid  if  interpreted  in  that  topology. 

PROOF.  Analogous  to  that  of  [20,  Corollary  18'A). 

Dual  versions  of  all  these  results  from  Proposition  5 onwards  could 
also  be  stated.  One  would  simply  impose  the  blanket  hypothesis  that  both 
(//.  ) and  (// 2>  hold  and  that  h and  P are  closed.  These  assumptions 
guarantee,  by  Proposition  2,  that  F and  G bear  the  needed  relationship 
to  each  other  and  that  F is  actually  closed. 

In  Propositions  2 through  7,  heavy  use  has  been  made  of  the  conditions 
(//^)  and  ( // ^ ) • We  now  give  a number  of  sufficient  conditions  for  these 
to  hold.  It  so  happens  that  the  sufficient  conditions  to  be  given  actually 
ensure  considerably  more.  In  particular,  they  ensure  attainment  in  the 
convolutions  appearing  in  (W^)  and  V! • They  also  ensure  closely  related 
subdifferential  formulas  which,  as  we'll  see  from  Corollary  12A  in  §5,  come 
into  play  in  simplifying  the  extremality  conditions  for  our  trio  of  problems. 
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In  order  not  to  take  up  excessive  space,  we  leave  to  the  reader  the 
easy  task  of  adapting  to  the  present  context  those  conditions  in  the  next 
proposition  which  are  of  the  most  relevance  to  him.  To  make  the  proposi- 
tion as  easily  applicable  to  (H^)  as  to  (H^)  notational ly , we  formulate 
it  in  terms  of  "neutral"  paired  spaces  Z and  W.  Notice  that  in  order 
to  guarantee  (//2)  v^a  these  conditions,  one  needs  k and  Q to  be  closed. 
In  specific  instances,  though,  it  just  might  be  possible  to  argue  that 
(// 2)  holds  by  ad  hoc  methods  not  requiring  this. 

In  the  proposition  conditions  (f)  through  (i)  are  stated  in  terms  of 

* + 

the  recession  functions  f^O  . These  are  given  by 

(f^0+)  (w)  = sup{f^(w'  + w)  - fi (w' ) |w'  f dom  f^}  , 

* 

and  serve  to  describe  the  growth  behavior  or  asymptotic  nature  of  f^ 

(cf.  (18,  §8]). 

PROPOSITION  8.  Let  f^  and  f2  be  extended-real-valued  proper 
convex  functions  on  Z.  Then 

( f ^ + f2)  (w)  - min{f1(w1)  + f2(w2)|w  = w1  + w2) 

and 

9(f1  + f2)  (z)  = 3f1(z)  + 3f  2 ( z) 

hold  whenever  any  one  of  the  following  conditions  is  fulfilled: 

(a)  there  exists  a z e dom  f^  in  a neighborhood  of  which  f2  is 
bounded  above; 

(b)  Z = Rn  = w and  0 e core  S,  where 

2 

S=  { (z.  , z ) | z . e Z and  ^ (z . + dom  f . ) } ; 

1 z 1 i=l  1 1 

(c)  Z is  a Banach  space  (in  the  designated  topology  compatible  with 
the  pairing),  f^  and  f2  are  closed,  and  0 £ core  S for  S as  in  (b)  ; 

(d)  Z = Rn  = W,  and  for  some  w and  some  real  a the  set 

* * * 

{(w1,w2)|wi  £ dom  f^,  w = w^  + w2,  f^fw^)  + f2(w2)  — 

is  nonempty  and  bounded; 
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(e)  f.  and  f2  are  closed,  and  for  some  open  set  M in  W the  set 
{(w1,w2)|wi  f dom  f*,  w1  + w2  t M,  f*^)  + f*(w2)  < a} 


is  nonempty  and  equicontinuous ; 


(f)  Z - H - W and  <t>  * ri  dom  £.,  where  the  relative  interior 

i=l  1 

"ri"  may  be  deleted  for  either  index  i for  which  f ^ may  happen  to  be 
polyhedral ; 

(g)  Z - Hn  = W,  and  for  all  w the  condition 

(f*0+)  (w)  + (fV ) (-w)  < 0 


impl ies 


(f*0+)  (-w)  + <f*0+)  (w)  < 0 


(h)  Z = R = W,  fj  is  polyhedral,  and  whenever  w satisfies 
(f*0+)  (w)  + (f*0+)  ( — w ) < 0 


it  follows  that 


(f*0+)  ( — w ) + (f*0+)  (w)  > 0 


(f*0+)  (w)  = (£*0+)  (w)  ; 


(i)  Z = Rn  = W,  q and  f2  are  polyhedral,  and 
(f*0+)  (w)  + (f*0+)  (-w)  > 0 . 

PROOF.  The  sufficiency  of  conditions  (a)  through  (e)  is  proved  in 
[20,  Theorem  20].  The  refinement  that  reflexivity  is  unnecessary  in  (c) 
follows  from  [16,  Corollary  1].  The  proof  under  condition  (f)  follows  by 
combining  Theorems  16.4,  20.1  and  23. f of  [18].  Finally,  conditions  (g), 

(h)  and  (i)  can  be  seen  to  be  the  dualized  versions  of  the  three  conditions 
contained  in  (f).  For  (g) , one  uses  Corollary  16.2.2  of  [18]  directly. 

For  (h) , one  uses  Theorem  13.3  and  Corollary  20.2.1  of  [18],  reformulating 


(The 


in  ..lightly  weakei " form  the  condition  given  in  Corollary  20.2.1. 
condition  as  stated  there  is  only  sufficient,  not  necessary  and  sufficient, 
for  (i),  we  shall  sketch  the  proof  that,  when  both  f^  and  f2  are 
polyhedral,  the  condition 


is  equivalent  to 


* doin  f^  n dom  f^ 


(f^O  ) (w)  + (f20+) (-w)  > 0 . 


By  using  the  same  technique  employed  in  the  proof  of  Corollary  16.2.2  of 
118),  we  see  that  it  suffices  to  establish  a polyhedral  version  of 
Lemma  16.2  of  [18],  That  is,  it  suffices  to  show  that  if  L is  a subspace 
of  R and  f is  a proper  polyhedral  convex  function  on  Rn,  then 


if  and  only  if 


<t>  * L C dom  f 


(f  0+) (w)  > 0,  w c h1 


But  this  can  be  established  by  modifying  the  proof  of  Lemma  16.2  of  [18], 
appealing  to  the  polyhedral  separation  theorem  [18,  Theorem  20.2]  in  place 
of  the  usual  finite-dimensional  one  [18,  Theorem  11.3).  This  concludes 
the  proof  of  the  proposition. 
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In 


this  section  we  treat  in  some  detail  the  issue  of  the  suboptimizations 
occurring  in  (P)  and  (P) . It  will  be  shown  that  (P) , (P)  and  even  (L) 
actually  arise  as  the  projections,  both  individually  and  as  an  optimization 
trio  collectively,  of  another  optimization  trio.  The  precise  connection 
between  the  optimal  values  and  solutions  for  the  three  pairs  of  correspond- 
ing problems  is  given,  as  well  as  a comparison  of  the  respective  extreraality 
conditions.  The  primal  and  dual  problems  of  the  new  trio  involve  no 
suboptimizations.  This  feature  comes  at  the  expense,  however,  of  having 
essentially  twice  as  many  problem  variables  and  perturbation  variables. 
Still,  since  the  new,  "expanded"  problems  involve  a fuller  class  of 
perturbations,  and  hence  entail  additional  sensitivity  information,  there 
may  be  situations  in  which  one  might  prefer  to  work  with  the  new  problem 
trio  instead. 

The  new  primal  problem  is 

min  (h(x)  - k(z)}  (to  find  both  x and  z)  , (P  ) 

x^>  0 , Ax^z 

and  the  new  dual  problem  is 

* * 

max  t {k  (y)  - h (w) } (to  find  both  y and  w)  . (D.) 

y M3 , w>A  y 

First,  we  establish  the  connections  between  these  and  our  earlier 
problems  (P)  and  (D) , in  which  the  variables  z and  w are  merely 
auxiliary.  Half  of  this  correspondence  requires  the  following  strengthened 
forms  of  (11^)  and  (//  ) : 

(h  + i|»p)  (v)  = min { h (v^  + <pp „ ( v^ ) I + v2  = v)  , (W^) 

* * 

(k  - <l>  *)  (u)  = max  ( k (u^ ) - ^q(u2^Iui  + u2  = u)  . (p^) 

Notice  that  a variety  of  conditions  sufficient  for  each  of  these  to  hold 
is  furnished  by  Proposition  8. 
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PROPOSITION  9.  The  optimal  values  satisfy 

inf (P)  = inf (P  ) and  sup(P)  = sup(P^). 

If  (x,z)  solves  (P^)  , then  x solves  (P)  . Conversely,  if  x solves 

(P)  and  if  (P^)  holds,  then  there  exists  a z such  that  (x,z)  solves 

(P^)  . If  (y,w)  solves  (P^) , then  y solves  (P) . Conversely,  if  y 

solves  (P)  and  if  (P.p  holds,  then  there  exists  a w such  that  (y,w) 

solves  (P^) . 

PROOF.  It  is  straightforward  to  check  that 

inffinf  (h(x)  - k(z)}}  = inf  (h(x)  - k(z)}  , 

x>_0  Ax>z  x>0,Ax>z 

so  the  optimal  values  in  (P)  and  (P^)  agree.  It  follows  that  if  (x,z) 

yields  attainment  of  the  infimum  on  the  right,  then  x yields  attainment 

of  the  outer  infimum  on  the  left.  Now  suppose,  conversely,  that  x yields 

attainment  of  the  outer  infimum  on  the  left  and  that  holds.  Then 

inf (P. ) = inf{h(x)  - k(z)} 

Ax>_z 

= h(x)  - s_up  (k  (z)  } 

Ax^z 

= h(x)  - sup{k  (Ax  - z)  - ifig(z)}  . 
z 

By  (P^)  » the  latter  supremum  is  actually  attained  at  some  z,  where 
without  loss  of  generality  (considering  the  possibility  that  the  supremum 
is  - “ trivially)  we  can  assume  that  z e Q.  Hence, 

inf(P^)  = h(x)  - k (Ax  - z) 

for  some  z e Q.  This  shows  that  the  pair  (x,z),  where  z = Ax  - z , 
solves  (P^) . The  assertions  concerning  (P)  and  (P^)  are  established 
similarly. 

COROLLARY  9A.  If  min(P^)  = max(P^),  then  min(P)  = max(P).  The 
converse  is  valid  when  both  (P^)  and  (P^)  hold. 

Our  next  aim  is  to  show  that  (P^)  is  indeed  a dual  of  (P^)  in  the 
sense  of  Rockafellar 's  perturbational  duality  theory  [18,20],  and  to 
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identify,  moreover,  the  saddle  point  problem  (Z.^)  corresponding  to  (ZJ^) 
and  (h^).  For  this,  it  is  necessary  to  parametrize  (ZJ^)  "convexly"  in 
such  a way  that  the  general  theory  in  (20j  yields  (Z^)  as  the  dual  problem. 
To  do  this,  we  shall  exhibit  functions  F^ , G^  and  satisfying 

identities  analogous  to  the  key  identities  (4.1)  and  (4.2). 

Define  F^  on  X x U « X x U,  on  V x y x V x y,  and  K ^ on 

X x U * V * Y by  means  of 

F^  (x , z , s , u)  = h ( x)  + ^q(z)  + 'I'pfx  + s)  - k (Ax  - z + u)  , 

G,(w,y,v,t)  = k ( y ) — ^ * (w)  - iJj  t (y  - t)  - h (A  y + w + v)  , 

P Q 

and 

K ( x , z , w , y ) = lh(x)  + \J/0(z)]  + (k  (y)  - tp  * (w)  ] 

1 y P 

- [<x,w>  + <Ax,y>  - <z,y>] 

if  (x,z)  f dom  h x P and  K^(x,z,w,y)  = + ® if  (x,z)  / dom  h x p.  it 
is  easy  to  see  that 

(Pj)  is  min  F1(x,z,0,0)  , 

x,  z 

(D^)  is  max  G^(y,w,0,0)  , 

y , w 

and  that  determines  a saddle  point  problem  over  the  product  set 

* 

(dom  h x p)  x (Q  x dom  k ).  We  define  this  saddle  point  problem  to  be  (Z,^). 

The  fact  that  (0^)  is  actually  the  dual  of  (P^)  and  that  (Z^)  is  the 
associated  Lagrangian  minimax  problem  follows  from  (20]  and  the  two 
identities  to  be  established  now. 

PROPOSITION  10.  The  functions  F^ , G^  and  satisfy  the  identities 

* 

Gjfw.yjV.t)  = -F  ^ (v , t , -w, -y ) 

and 

K (x,z,w,y)  = inf(F  (x,z,s,u)  + < (s,u) , (w,y)  >}  . 
s , u 
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PROOF.  These  can  be  derived  most  easily  in  stages. 


First  suppose 


q is  some  function  convex  on  X * U and  that  B : X ■+  U is  a continuous 
linear  operator.  If  H is  defined  as 

H (x,u)  = q (x,u  + Bx)  , 

it  is  routine  to  check  that 

* * * 

-H  (v,-y)  = -q  (v  + B y,-y) 


and 


inf(H(x,u)  + <u,y>}  = inf{q(x,u)  + <u,y>}  - <Bx,y>  . 
u u 

Now  apply  these  identities  with  the  choices 

q ( x , 2 ; s , u ) = h (x)  + ^Q(z)  + t)/p(s)  - k(u) 


and 


B(x,z)  = (x,Ax  - z)  . 

* * 

It  is  routine  also  to  check  that  q and  B are  given  by 

q ( v , t ; w , y ) = h (v)  + + i|jpo(w)  - k (-y) 

and 

* A 

B (w,y)  = (A  y + w,-y)  . 

Upon  substitution  we  see  that  H becomes  F^,  etc.,  and  the  desired 
identities  follow  from  those  already  noted  for  H. 

COROLLARY  10A.  One  always  has  the  estimate 

Fx  (x , z , 0 , 0 ) > G1  (w,y,0,0)  . 

Moreover,  equality  is  attained  by  pairs  (x,z)  and  (w,y)  if  and  only 
if  (x,z)  solves  (P^),  (w,y)  solves  (P^),  and  inf(P^)  = sup(P^). 

PROOF.  Similar  to  that  of  Corollary  1A. 

We  turn  now  to  the  connection  between  the  two  Lagrangian  problems 
(L)  and  (Lj)  . 

PROPOSITION  11.  Assume  P is  closed.  Then 

sup  inf  £ sup  inf  K £ inf  sup  K £ inf  sup  . 

If  in  addition  (//^)  and  (Z^)  hold,  then  the  two  lower  saddle  values  agree 
and  the  two  upper  saddle  values  agree. 


-31- 


PROOF.  The  middle  inequality  is  always  true,  as  can  be  easily 
verified.  The  assertions  about  the  "sup  inf"  expressions  follow  from  the 


computations 

sup  inf  = 

w,y  x,  z 

sup 

inf 

{ h ( x ) + 

k* (y ) - 

x-w  - Ax-y  + z • y } 

weP*  * 

ze  Q 

ye  dom  k 

xe  dom  h 

= 

sup 

( k (y)  - 

sup 

{ x ■ ( A y 

+ w)  - h (x)  + sup 

w«P  * 
ye  dom  k 

xe  dom  h 

ze  Q 

* * * 

= sup  * sup  {k  (y)  - h (A  y + w)  ) 

yt  Q Odom  k we  P 

= sup  { (k  - t|>  *)  (y)  - (h  □ c)  (A  y)  } 
yt  o 0 

and 

* 

sup  inf  K = sup  inf  lh(x)  + k (y)  - <Ax,y>] 
y x ye  D xc  C 

* * 

= sup  (k  (y)  - sup{<x,A  y>  - h(x)}} 
ye  D xe  C 

= supf  (k  - i p *)(y)  - (h  + tp  ) (A  y)  } 
ye  D Q 

(where  we  have  abbreviated  the  bilinear  pairing  functions  by  the  "dot" 

♦ * 

notation  to  shorten  the  formulas).  Since  in  general  (h  + i|/p)  £ (h  □ 

it  follows  that 

sup  inf  <_  sup  inf  K 

always  holds,  while  if  ( // ^ ) holds  we  actually  have  equality.  For  the 

"inf  sup"  assertions  we  proceed  similarly,  calculating  that 

* 

inf  sup  K.  = inf  sup  (h(x)  + k (y)  - x-w  - Ax-y  + z-y) 

x,zw,y  zeQ  weP*  4 

xe  dom  h ye  dom  k 

= inf  {h  (x)  - inf  * { (Ax  - z) -y  - k (y)  + inf*  x-w}} 
ze  Q ye  dom  k we  P 

xe  dom  h 

= inf  inf{h(x)-(clk)(Ax-z)} 

xe(dP)n  dom  h ze  Q 

= inf  ( (h  + t{/cl  p)  (x)  - (cl  k Cl-ifi  ) (Ax)  } 

xe(cl  P)  n dom  h 
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and 


inf  sup  K 
x y 


inf  sup{h  (x)  + k (y)  - <Ax,y>} 
xf  C yf  D 


inf{h(x)  - inf{<Ax,y> 
Xf  C ye  D 

inf  { (h  + ) (x)  - (k 

xeC 


k*(y)  }} 


*)  (Ax)  } . 

0 


Now  in  general  one  has 


(k  - 


ip  *)  = cl  (k 

Q 


n-ij'Q 


) 


(cl  k 


> (k  n-^Q) 


Thus,  if  P is  closed  it  follows  that 

inf  sup  Kq  >_  inf  sup  K . 

* * 

If  in  addition  ( H 2)  holds,  then  (k  -!('*)=  (cl  k Q— ^0>  , and  so  we 

Q U 

actually  have  equality. 

COROLLARY  11A.  Assume  P is  closed.  If  the  saddle  value  in  (Z,^) 
exists,  then  so  does  the  saddle  value  in  (Z,)  and  the  two  values  coincide. 
Conversely,  if  the  saddle  value  of  (P)  exists  and  (p^)  and  («2)  hold, 
then  the  saddle  value  of  (/,^)  exists  and  the  two  values  coincide. 

The  connection  between  inf(P),  sup(P)  and  the  lower  and  upper  saddle 
values  of  ( Z, ) was  noted  in  Corollary  2A.  The  parallel  assertions  concern- 
ing (P^) , (P^)  and  (i^)  are  that 

inf(P^)  = inf  sup(L^)  if  P and  k are  closed, 

while 


sup(P^)  = sup  inf(L^) 

always  holds.  These  facts  follow  from  the  identities  of  Proposition  10 
and  (20,  pages  18-19]. 

Now  consider  the  abstract  Kuhn-Tucker  conditions  corresponding  to 
(Pj.),  (PL)  and  (Z^): 

(0,0, 0,0)  c 3K(x,w,y,z)  . 

These  are  characterized  and  contrasted  with  those  corresponding  to  (P)  , (P) 

and  (£)  in  the  next  result  and  its  corollary. 
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PROPOSITION  12.  Vectors  x and  y satisfy  (0,0)  e ?K(x,y)  if 
and  only  if 

A y f D ( h + i/*p)  (x)  and  Axe  3 (k  - ^*)(y)  • (5.1) 

Q 

Vectors  x,  z,  w,  y satisfy  (0,0, 0,0)  e 3K^ (x , z ,w, y ) if  and  only  if 

x e cl  P,  w f P , <x,w>  = 0 , (5.2) 

z e Q,  ye  Q* , <z,y>  = 0 , (5.3) 

* * 

A y + w e 3h(x)  and  Ax  - z e 3k  (y)  . (5.4) 

PROOF.  The  first  assertion  was  established  following  (4.10).  The 
same  approach  used  there  can  be  used  to  obtain  the  second  assertion.  In 
(4.10)  replace  h by  the  function  (x,z)  •+  h(x)  + iji  (z)  , replace  k 


by  the  function  (s,u)  ■+  -ipp(s)  + k(u),  and  replace  A by  the  linear 

* 

transformation  (x,z)  -►  (x,Ax  - z) . Then  A becomes  the  transformation 

* * * * 

(w,y)  ->•  (A  y + w,-y)  and  k becomes  the  function  (w,y)  (-ilp)  (w)  + k (y)  . 

Substitution  of  these  ingredients  into  (4.10)  yields  that 

(0, 0,0,0)  « 3K1(x,z,w,y) 

if  and  only  if 

* * * 

A y + w c 3h(x),  Ax  - z e 3k  (y)  , -y  c 3i|iq(z),  x c 3(-i)/p)  (w)  . 

* 

Finally,  it  is  routine  to  show  that  x e 3 (-1)0  (w)  is  the  same  as  (5.2) 

and  that  -y  f Si^tz)  is  the  same  as  (5.3). 

The  converse  part  of  the  following  corollary  establishes  hypotheses  under 
which  the  extremality  conditions  (5.1)  can  be  broken  down  into  (5.2), 

(5.3)  and  (5.4).  Its  statement  utilizes  the  conditions 

3(h  + ipp)  (x)  = 3h(x)  + 3<|'p  (x)  , (//”) 

3 (k  - ij/  *)  (y)  = 3k  (y)  - 3^  * (y ) . {//,) 

Q 0 

Notice  that  Proposition  8 provides  a variety  of  sufficient  conditions 
ensuring  that  these  hold. 

COROLLARY  12A.  If  (x,z,w,y)  solves  (L^)  and  P is  closed,  then 
(x,y)  solves  (L) . Conversely,  if  (x,y)  solves  ( L ) , Q is  closed,  and 
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I 


both  ( //,  ) and  ( II .>)  hold,  then  there  exist  vectors  z and  w such  that 
(x,z,w,y)  solves  (L^). 

PROOF.  Suppose  first  that  (x,z,w,y)  solves  (L^).  Then  the  proposi- 
tion yields  (5.2),  (5.3)  and  (5.4).  Now  (5.2)  is  the  same  as  -we  3^p(x) 

when  P is  closed,  and  (5.3)  implies  -z  e 3iJj  *(y).  In  view  of  the 

Q 

general  inclusions 

3h(x)  + dip  (x)  c 3 (h  + <J)  ) (x)  , 3k*  (y)  - 3^  *(y)  c 3(k*  - i p *)(y)  , 

Q Q 

(5.4)  then  yields  (5.1).  Now  suppose  conversely  that  (x,y)  solves  (L)  . 

M II 

If  (W^)  and  (Z/j)  both  hold,  then  by  (5.1)  we  know  there  exist  vectors  z 

and  w such  that  -w  e 3i^  (x)  , -z  e 3 ifi  *(y),  and  (5.4)  hold.  Now 

Q 

-w  e 3iJj  (x)  implies  (5.2),  and  -z  e dip  * (y)  is  the  same  as  (5.3)  when 

Q 

Q is  closed.  Hence  the  proposition  implies,  in  the  presence  of  the 
assumptions  mentioned,  that  (x,z,w,y)  solves  (Lp) . 

It  is  interesting  to  examine  the  primal  and  dual  optimal  value  func- 
tions associated  with  the  duality  between  (P^)  and  (C^) : 

*^(s,u)  = inf  F^(x,z,s,u) 

X , z 

= inf{h(x)  - k(z)|x  + s 0,  Ax  + u >_  z) 

and 

Y1(v,t)  = sup  G^w.y.v.t) 
w,y 

= sup{k  (y)  - h (w)  |y  t,  w > A y + v)  . 

Comparison  of  these  with  'f  and  y,  given  in  (4.4)  and  (4.5),  shows  that 
the  new  trio  of  problems,  involving  more  explicit  variables,  is  based  on 
perturbing  the  "nonnegativity"  constraints  in  addition  to  the  "linear 
inequality"  constraints.  Thus,  the  sensitivity  information  given  by  the 
model  with  more  (primal  perturbation)  variables  is  more  comprehensive, 
though  at  the  price  of  having  to  deal  with  additional  (dual  problem) 
variables . 


h 


— ---■ 
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One  might  reasonably  inquire,  therefore,  which  model  problem,  (!) 


or  (P^),  is  the  more  appropriate  on  which  to  focus  the  main  attention. 

The  answer  would  seem  to  depend  mainly  on  the  role  being  played  by  the 
nonnegativity  constraints  in  the  actual  problem  being  studied.  If,  as  is 
quite  often  the  case,  the  nonnegativity  constraints  are  deemed  relatively 
inviolable,  then  the  original  cone-augmented  problem  (F)  seems  indicated. 
On  the  other  hand,  if  one  has  some  need  for  sensitivity  information 
concerning  discrepancies  in  satisfying  the  nonnegativity  constraints,  and 
is  at  the  same  time  willing  to  admit  into  the  calculations  additional 
explicit  dual  problem  variables,  then  the  model  involving  {f  ) seems 
indicated.  Either  (P)  or  (P^)  will,  of  course,  yield  sensitivity  informa- 
tion concerning  the  general  linear  inequality  constraints. 

The  reader  can  formulate  with  little  difficulty  the  parallel  versions 
of  Propositions  3 through  7 for  the  trio  (P^)  > (P^)  , (P^)  . 
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6.  One  optimization  trio  as  the  imago  of  another.  Results  in  the 
last  section  show  that  (P)  , (P)  and  (L) , taken  individually,  are  the 

"projections"  of  (P^),  (P^)  and  (P^)  • Now  we  show  that,  in  a precise  sense, 

the  entire  optimization  trio  (P) , (P) , ( L ) is  the  image  of  the  trio  (P^), 

(P^),  < Z, ^ ) under  a certain  type  of  projection  transformation.  This  will 

yield  an  alternate  formulation  of  the  question  whether  identity  (4.1)  holds, 
one  which  reveals  much  more  clearly  the  connection  with  the  suboptimiza- 
tions occurring  in  F and  G.  The  transformations  involved  are  more 
general  than  the  ordinary  projection  linear  transformations;  namely,  they 
are  particularly  simple  types  of  convex  processes  (see  [18,  §39]  for 
definitions).  The  "self-dual"  form  of  these  transformations  will  help  to 
explain  why  the  extreme  symmetry  possessed  by  the  trio  (P^)  , (P^),  (p^) 

is  passed  on  intact  to  the  image  trio  (P) , ( D ) , (P) . 

Consider  first  the  convex  process 

M:XxUxXxU-*-XxU 


defined 


by 


where  we  assign 
the  sup-oriented 


M (x  , z , s , u)  = 


{ (x,u)  } if  s=0 

|^0  if  s * 0 , 

M the  supremum  orientation.  It  is  not  hard  to  see  that 
convex  process 

M*-1  :VxyxvxY^vxy 


is  given  by 


Now  let 
which  is 
under 


*-l 

M (v,t,w,y) 


{ ( v , y ) } if  t 


0 


1 if  t * 0 . 

* - 1 

N be  the  convex  process  having  the  same  graph  as  M but 

assigned  instead  to  the  infimum  orientation.  Then  the  image  of 
M is  F,  while  the  image  of  G^  under  N is  G.  Indeed, 
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(MF1)(x,u)  = inf 

M_1 (x,u) 


= inf (F  (x, z, 0,u) } 


F(x,u)  , 


(NG^ ) ( v , y ) = sup  G1 
N 1(v,y) 

= sup { G.  (w,y , v, 0)  } 

w 

= G(y,v)  , 


where  the  last  equalities  in  each  case  are  straightforward  calculations. 

From  these  identities,  we  see  that  it  is  the  self-dual  structure  of  M 

that  permits  the  symmetry  between  F1  and  G^  to  be  passed  on  to  F and  G. 


One  also  has  that 


:(-y,v)  = -sup{G1 (w,-y,v,0) } 


= inf {-G, (-w,-y, v, 0) } 


= inf {F1 (v, 0, w,y) } 


= *inf  F 
M (v,y) 

= (M*-1F*) (v,y)  . 

Together  with  the  two  earlier  identities,  this  shows  that  the  underlying. 


central  issue  of 


G(y,v)  = -F  (v, -y ) 


is  actually  equivalent  to  the  question 


* •>  * 
M Fj  = (MFj ) 


The  problem  of  providing  general  conditions  ensuring  that  such  a duality 
identity  holds  between  a convex  function  and  a convex  process  was  first 
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dealt  with  by  Rockafellar  118,  Theorem  39.7].  The  infinite-dimensional 
case  is  treated  in  McLinden  [10],  where  the  associated  subdifferential 
formula  is  also  derived. 

Finally,  let  us  see  how  the  passage  from  (f^)  to  (Z.)  can  also  be 
viewed  in  similar  terms.  For  this,  regard  the  ordinary  projection 
L^(x,z)  = x as  a sup-oriented  convex  process  and  likewise  regard  the 
projection  L2(w,y)  = y as  an  inf-oriented  convex  process.  It  can  be 
checked  that  each  of  the  two  saddle  functions 

(x,y)  •+  inf  sup  K. 

T — 1 "I 

x L2  y 

and 


(x,y)  ->  sup  inf  K. 
l2  y lx  x 

has  effective  domain  C x d and  agrees  with  K there.  It  follows  that 
each  of  these  two  possible  ways  of  forming  the  image  of  under  the 

"product  convex  process"  L = x L2  gives  rise  to  (£) . Notice  also 
that  M and  N can  be  expressed  in  terms  of  and  as 

*- l 

M = Lj  x 12  and  N = 1^  * L2  , 

provided  we  interpret  L2  as  sup-oriented  and  as  inf-oriented. 

The  above  furnishes  an  outline  which  could  clearly  be  extended  to 
product  convex  processes  more  general  than  M,  resulting  in  a general 
treatment  of  the  effects  of  "projecting"  one  trio  of  optimization  problems 
onto  another.  Of  particular  interest  would  be  the  associated  suboptimiza- 
tions (the  counterpart  of  the  z's  and  w's  here)  and  also  the  ways  in 
which  various  classes  of  perturbations  would  be  transformed. 
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1 

7. Special  functional  structure.  In  this  section  we  give  conjugacy 

and  subdifferential  formulas  for  certain  useful  objective  function 
structure.  This  information,  when  combined  with  the  symmetric  cone 
constrained  duality  model  developed  above,  provides  the  basis  for  treating 
symmetrically  a variety  of  specific  classes  of  model  problems.  In  §3  we 
indicated  how  one  would  obtain  quadratic  and  homogeneous  programming.  The 
same  approach  applies,  using  the  tools  which  follow,  to  provide  duality 
treatment  for  functions  homogeneous  of  any  nonzero  degree.  (Of  course  in 
general,  one  need  not  necessarily  pick  the  family  B to  satisfy 
B — -A  . See  § 3 . ) 

The  class  of  functions  to  be  treated  first  (in  Proposition  13  below) 

may  be  heuristically  viewed  as  a rather  broad  generalization  of  convex 

2 

"distance"  functions,  such  as  the  function  x « ( 1/2 ) 1 1 x 1 1 ' in  a normed 
space.  Here,  the  role  of  the  norm  will  be  played  by  the  gauge  of  a convex 
set  containing  the  origin,  and  the  role  of  the  quadratic  "scaling"  func- 
tion will  be  taken  over  by  a generalized  Young's  function  on  the  half- 
line.  Before  giving  the  result,  we  recall  from  Rockafellar  [18]  certain 
relevant  material. 

The  polar  of  a nonempty  convex  subset  C of  X is 
C°=  ( v | < x , v > ^ 1 , Vxt  C}  . 

It  is  a basic  fact  that  C°°  is  the  closure  of  the  convex  hull  of  C and 
the  origin.  Consequently,  if  C is  itself  closed  and  contains  the  origin, 
then  C°°  = C.  We  shall  call  such  a set  a polar  set . A gauge  on  X is 
a positively  homogeneous  proper  convex  function  on  X which  is  nonnegative 
and  vanishes  at  the  origin.  The  polar  of  a gauge  y is  the  function 
Y°  (v)  = inf{0  <_  y < + * |<x,v>  <_  p • y(x),Vx)  . 

This  is  a closed  gauge  on  V,  and  one  has  y°°  =cly.  The  closed  gauges 
on  X are  in  one-to-one  correspondence  with  the  polar  sets  in  X via 
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Y (x)  = inf  (O  <^u<+"|x£  uC) 

and 

C = { x | Y (x)  < 1}  . 

It  is  convenient  to  write  yc  for  the  gauge  corresponding  in  this  way 

to  a polar  set  C,  and  one  has  (yc)  0 = Yc<>-  a function  f : X -*•  [-»,+  ») 

is  called  gaugelike  provided  f ( 0 ) = inf  f < + °°  and  the  various  level  sets 

X 

{x|f(x)  <_  a},  f(0)  < a < +", 

are  all  proportional  (i.e.  can  all  be  expressed  as  positive  scalar  multiples 
of  a single  set).  If  <t  : (0,+  °°)  ■*  (-<»,+  <»)  is  a nondecreasing  convex 
function  which  is  finite  at  zero,  then  its  monotone  conjugate  is  the  func- 
tion : [0 , + 00  ) -*■  (-“>,+  “]  given  by 

^+(t)  = sup  {ot  - <p  (o)  } . 

0<o<+  °° 

This  is  another  such  function,  and  moreover  it  is  lower  semicontinuous . 

One  has  v>++  = lsc  , the  lower  semicontinuous  hull  of  • If  s p is 

nonconstant  and  finite  somewhere  on  (0,+  °°),  then  v>+  has  these  same 
properties.  From  the  definition  of  it  follows  that  one  always  has 

<p  (a)  + *>+(t)  >_  ot,  Vo,  t e 10,+°“)  . 

The  subdif rerential  of  <p  is  the  multivalued  mapping  9^  : (0,+  °°)  + [0,+  °°) 

defined  by 

t e 9^(o)  if  and  only  if  >p(a)  + v>+(t)  = ot  . 

The  set  9^  (a)  amounts  to  simply  the  derivative  at  points  o where  <t 
is  differentiable.  Monotone  conjugacy  for  functions  on  [0,+°°  ) may  be 
viewed  as  the  natural  generalization  of  the  classical  facts  concerning 
Young's  functions.  We  are  now  in  a position  to  present  the  first  result. 

PROPOSITION  13.  A function  f is  a gaugelike  closed  proper  convex 
function  if  and  only  if  it  can  be  expressed  in  the  form 

f (x)  = <t>  (y  (x)  ) , 
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- - 


where  y is  a closed  gauge  and  ^ is  a nondecreasing,  lower  semicontinuous 
convex  function  on  [0,+  ")  which  is  nonconstant  and  finite  somewhere 


on  (0,+  “).  (Here  ■?  ( + <"  ) is  to  be  interpreted  as  + » in  the  formula 

* 

for  f.)  In  this  case  f is  gaugelike,  too,  and  in  fact 

f (v)  = <^  + (y°  (v)  ) , 

where  satisfies  the  same  conditions  as  y . Moreover,  one  then  has 

v t 3f(x)  if  and  only  if 

< x,v>  = > (x)  • Y°(v)  and  Y°(v)  e 3v>  ( y (x)  ) , 

and  the  sets 

(x|y(x)  £ 1},  {v| y°  (v)  £ 1} 

are  polar  to  each  other. 

PROOF.  See  Rockafellar  [18,  Theorem  15.3,  .or  the  original,  finite- 
dimensional presentation  of  this  result.  The  proof  given  there  extends, 
in  broad  outline  form,  to  the  general  case;  see  McLinden  [9]  for  details 
in  the  infinite-dimensional  case. 

"Quadratic"  convex  functions  are  included  in  the  case  p = 2 of  the 
following  corollary.  The  case  in  which  y is  a norm  is  also  quite 
important . 

COROLLARY  13A.  A function  f is  closed  proper  convex  and  positively 
homogeneous  of  degree  p,  where  l<p<+»,  if  and  only  if  it  is  of 
the  form 


f(x)  = (l/p)Y(x)p 


case  in  which  C and  C°  are  the  unit  balls  of  polar  norms  is  of 
particular  importance. 

* * 

COROLLARY  13B.  Let  C be  a polar  set.  Then  Yc  = tpc<>  and  yc  = i 
Moreover,  v e 3yc(x)  if  and  only  if  <x,v)  = Yc(x)  * yCo  (v)  and  either 

Yc(x)  = 0 and  Yco  (v)  <_  1 

or  else 

Yc(x)  > 0 and  YCo = 1 • 

PROOF.  The  proposition  applied  to  f = v>  ° Yc»  where  v>(o)  = Oi 

* -f  * 

yields  f = ° Yc»-  Since  * (t)  = ' thls  means  Yc  = ♦<*«>• 
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is  closed. 


Takiiv)  conjugates  then  yields  the  first  identity,  since  y 
The  suhdifferenti.il  characterization  follows  by  the  proposition  from  the 
tact  that  i t Co ) if  and  only  if  a = 0 and  0 £ i £ 1 or  o>0 
and  t=l. 

We  have  promised  coverage  of  positive  homogeneity  of  any  nonzero 
degree  p.  For  p < 1,  this  clearly  puts  us  most  naturally  into  the  realm 
of  concave  functions.  What  we  shall  do  is  present  a natural,  concave 
analogue  of  Proposition  13.  It  turns  out  that  the  class  of  functions  it 
treats  can  be  heur istical ly  viewed  as  concave  "utility"  functions,  much 
as  those  of  the  previous  discussion  were  convex  "distance"  functions.  To 
formulate  this  concave  analogue  (Proposition  14),  we  require  appropriate 
analogues  of  the  concepts  and  facts  used  earlier.  For  more  on  the  follow- 
ing material,  see  McLinden  [9]. 

Let  C be  a nonempty  convex  subset  of  X such  that  0 / cl  C.  The 
antipolar  of  C is 

C°  = {v|<x,v>  > 1,  vx  t C)  . 

(Here,  and  below,  we  rely  on  the  context  to  indicate  whether  the  symbols 

O .f  * 

, , , and  cl  are  to  be  interpreted  in  the  earlier,  convex  sense  or 
in  the  present,  concave  sense.)  It  is  a basic  fact  that  C0”  is  the  set 
cl{Ax|A  >_  1,  x f C)  . Hence,  C°°  = C if  and  only  if  C is  a nonempty 
closed  convex  set  which  excludes  the  origin  and  satisfies  the  condition 

Ax  f C for  all  A >_  1 and  x c C . 

We  call  such  a set  an  antipolar  set ■ (A  particularly  nice  example  of  an 

antipolar  set  in  X = Rn  is  the  "hyperbolic"  set  C = { (tj.  ,...,£)  | > 0 

each  i,  and  f,  > — } . This  has  the  self-dual  property  C°  = C.) 

I z n — n 

An  ant igauge  on  X is  a positively  homogeneous  proper  concave  function  on 
X which  vanishes  at  the  origin  and  is  nonnegative  but  not  identically 
zero  on  its  effective  domain.  The  antipolar  of  an  antigauge  y is  the 
function 
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Y ° ( v)  = sup{  0 <_  v < + °°  |<x,  v > >U-Y(x),  Vx  f dom  y>  , 
where  we  use  the  convention  sup  t>  = - <*>  . This  function  is  a closed 
antigauge  on  V,  and  one  has  Y°°  = cl  y-  The  closed  antigauges  on  X are 
in  one-to-one  correspondence  with  the  antipolar  sets  in  X via 


] 

C sup  { 0 <_  p < + «|x  e pc) 

if 

X 

c 

cone  C 

Y(x)  = < 

1 

0 

1 

if 

X 

€ 

asym  C 

Loo 

if 

X 

/ 

rec  C 

and 

C = {x | y (x)  > 1}  . 

Here  rec  C denotes  the  recession  cone  of  C (i.e. 

rec  C = {z|x  + Xz  e C,  Vx  e C V>  > 0}),  cone  C denotes  the  projecting 

cone  of  C (i.e.  C = (Xx|x  c C,X  > 0)),  and  asym  C consists  of  what 

might  be  thought  of  as  the  asymptotes  of  C,  namely  asym  C = rec  C X cone  C. 
(Some  feel  for  asym  C may  be  gained  by  considering  a few  simple  examples 
in  the  plane.  If  C1  = { ( , C,)|  £2  >_  1 } , then  asym  C1  = { (f^  . 0)  [ £ e R)  . 

If  C2  = ( (£j  ' ?2>  I f "2  — 1 ' ^i  — 0 J » then  asym  C 2 = { (£j  , 0)  | £ >^0}.  If 

C3  = < ^1  — 1 — ^1^2'  or  else  1 1 ' ^2  ^ ' then 

asym  C3  = { (£^,0)  | 1 0}  u { (0,  £2)  | £ >_  0}.  The  set 

D3  = ( (Cx , C2) |?2  > e X)  is  not  antipolar,  but  = D°°  is.  One  can 

check  that  C4  = { (Cj.Cj)  | £2  >_  e 1 and  ( < 1,  or  else  £2  >_  ef^  and 

1 1 Cj),  so  that  asym  C4  = {(£  ,0)1^  £ 0}.  The  set 


{(C1,C2)  U2  > 1 

is 

not 

antipolar,  but  = D°°  is, 

. One  has 

{ <Ci ' e2>  l?2  - 1 

+ 

and 

I«1 

1 1 1,  or  else  C2  1 2 | ^ | 

and 

^ 1}  and  asym 

C5  = 

{ (0, 

0)  ) .) 

It  is  convenient  to  write 

Yc  for  the 

antigauge  corresponding  in  the  above  manner  to  an  antipolar  set  C,  and 
one  has  (Y^)°  = We  shall  call  a function  f : X [-«>,+  <»]  anti- 

gaugelike (admittedly,  a verbal  monstrosity!)  provided  that,  on  the  set 
(x|f(x)  > - 00  ) , f is  nonconstant  and  bounded  below  by  f(0),  and  that 
the  various  level  sets 
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{ x | f ( x ) _>  a),  f (0 ) < a < sup  f 

X 

are  all  proportional  (i.e.  can  all  be  expressed  as  positive  scalar  multiples 
of  a single  set).  If  <p  : [0,+  °°)  -»(-«>,+  «>)  is  a non  decreasing  concave 

function  not  identically  - °°  , then  its  monotone  conjugate  is  the  func- 
tion v>+  : [0,+  <“)  given  by 

= inf  {ot  - v>  (o  ) ) . 

0<o<+ 

This  is  another  such  function,  and  moreover  it  is  upper  semicontinuous . 

One  has  ^ + + = use  <t , the  upper  semicontinuous  hull  of  y>  . If  v>  is 
nonconstant,  then  is  also  nonconstant.  From  the  definition  of  + 

it  follows  that  one  always  has 

v’(o)  +v?+(t)  < ot,  Vo,  T f [ 0 , + °°  ) . 

The  subdi  fferential  of  >p  is  the  multivalued  mapping  3^  : [0,+  °°  ) -*•  [0,+  “) 
defined  by 

t f 3^(o)  if  and  only  if  (o)  + ^+(t)  = at  . 

As  before,  3*>  (a)  amounts  to  simply  the  ordinary  derivative  at  points 
0 where  is  differentiable.  Armed  with  these  notions  and  facts,  we 

can  proceed  to  the  concave  analogue  of  Proposition  13. 

PROPOSITION  14.  A function  f is  an  antigaugelike  closed  proper 
concave  function  if  and  only  if  it  can  be  expressed  in  the  form 

f (x)  = <e  ( y (x)  ) , 

where  y is  a closed  antigauge  and  <?  is  a nondecreasing,  nonconstant, 

upper  semicontinuous  concave  function  on  [ 0 , + °°  ) . (Here  (- 00  ) is  to 

* 

In  this  case  f is 

Moreover,  one  then  has 

v f d t i x j it  and  only  it 


be  interpreted  as  - °°  in  the  formula  for  f.) 
antigaugelike,  too,  and  in  fact 

f* (v)  = *+  (y° (v) ) , 

where  satisfies  the  same  conditions  as  v> . 
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and  the  sets 


<x,v>  = y(x)  • y°(v)  and  y'fv)  c 3*>(Y(x))  , 


(x|y(x)  >_  1},  {v|  y°  (v)  >_  1} 

are  antipolar  to  each  other. 

PROOF.  See  McLinden  (9). 

The  following  corollary  completes  the  treatment  of  positive  homogeneity 
of  nonzero  degree  p.  (The  case  - °°  < p < 0 corresponds  to  the  dual 
version  of  the  corollary.) 

COROLLARY  14A.  A function  f is  closed  proper  concave,  nonconstant 
on  its  effective  domain,  and  positively  homogeneous  of  degree  p,  where 
0 < p < 1,  if  and  only  if  it  is  of  the  form 


f (x)  = (^)Y(x)P 

* 

for  some  closed  antigauge  y.  In  this  case  f is  positively  homogeneous 

of  degree  q,  where  — + — = 1;  in  fact, 

P 9 


f (v) 


(v)' 


if  y°(v)  > 0 
otherwise 


One  then  has 

<x,v>  [pf  (x)  ) ^'P  [qf  (V)  ] 1/q  > 0,  Vx  f dom  f,  Vv  e dom  f , 
and  the  sets 

{ x | f ( x ) > i),  { v | f * ( v)  > -} 

- p - q 

are  antipolar  to  each  other.  Moreover,  v e 3f(x)  if  and  only  if 
Y(x)  > 0,  Y°(v)  > 0, 

< x,v>  = Y (x)  • Y°(v)  and  Y°(v)  = Y(x)P_1  . 

PROOF.  We  proceed  in  a manner  quite  similar  to  that  for  Corollary  13A. 
First,  suppose  f is  of  the  form  f = (— )Y^  for  some  0 < p < 1 and 
closed  antigauge  y*  Then  it  is  clearly  nonconstant  and  positively  homo- 
geneous of  degree  p,  and  furthermore,  for  ^>  ( a ) = it  is  of  the 

form  treated  by  the  proposition,  and  hence  is  closed  proper  concave.  On 
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the  other  hand,  suppose  f is  closed  proper  concave,  nonconstant  on  its 
effective  domain,  and  positively  homogeneous  of  degree  p for  some 
0 < p < 1.  One  can  deduce  routinely  that  f (0)  = 0,  that  f(x)  > - «. 
implies  f(x)  ^ 0,  and  that  C = {x|f(x)  - } is  an  antipolar  set.  (The 

nonconstancy  assumption  is  needed  to  show  C is  nonempty) . Then  for  each 
0 < a < + oo  one  can  show  that 

{ x ! f ( x ) >_  a)  = (up)^pC  = { x I ‘r’  « Yp(x)  >_  a)  . 


where  <f  (o)  = (i)aP.  From  this  it  follows  that  f = <p  ° v_.  The  remainder 
P c 

of  the  corollary  now  follows  from  the  proposition,  since  v>+(i)  = (~) 
for  0 < t < + “ and  v>+(0)  = - •»  . 

* 

COROLLARY  14B.  Let  C be  an  antipolar  set.  Then  yc  = (-<lCo)  and 

* 

Y„  = Moreover,  v e 3 Y„(x)  if  and  only  if  <x,v>  = y„(x)  • y „ (v) 


and  either 


or  else 


Yc  (x)  = 0 and  yco  (v)  £ 1 


Yc(x)  > 0 and  YCo(v)  = 1 . 

PROOF.  The  proposition  applied  to  f = f ° y^,  where  <p  (o)  = o, 

* + 4- 

yields  f = ^ ° yco-  Since  * (f)  = _^’[x  + „ ) (t)  > this  means 

* 

Yc  = o • Taking  conjugates  then  yields  the  first  identity,  since  Yc 
is  closed.  The  subdifferential  characterization  follows  by  the  proposition 
from  the  fact  t>  -t  t c 3^  (o)  if  and  only  if  either  a = 0 and  t >_  1 
or  else  o > 0 and  t = 1. 

t 

The  situation  treated  in  Corollary  14B  amounts  to  the  concave  version 
of  positive  homogeneity  of  degree  p = 1. 

In  terms  of  viewing  the  functions  in  Proposition  14  as  concave 
"utility"  functions,  still  other  choices  of  the  "scaling"  function  <p 
besides  p^*1  powers  are  of  interest.  We  shall  cite  just  three,  leaving 
it  to  the  reader  to  formulate  the  corollaries  corresponding  to  these 


choices  as  well  as  others.  These  three  each  have  the  nice  feature  that 
yf>+  = $ + a,  where  a is  some  real  constant.  Upon  replacing  v>  by 
V - ct/2,  one  could  thus  obtain  complete  self-duality,  i.e. 

(*>  + a/2)+  = + a/2.  Of  course,  3 (*>  + a/2)  = 3^  . In  general,  the  ^‘s 

which  are  self-dual  (up  to  an  additive  constant  as  above)  are  precisely 

those  whose  subdifferentials  are  symmetric  upon  reflection  through  the 
2 

axis  o = t in  R+. 

Example  1.  Take  *>{o)  = *n  o for  0 < o < + °°  and  v>(0)  = - °>  . 

Then  v>+  = v>  + 1.  The  graph  of  the  subdifferential  3v>  here  is 
2 

{(o,t)  e R+|ot  = 1}.  By  comparing  this  graph  with  the  graphs  of  the  sub- 
differentials of  the  pth  powers  appearing  above,  one  sees  this  as  the 
natural  limiting  case  corresponding  to  p = 0.  See  McLinden  (9]  for  more 
on  this  point.  The  subgradient  formula  one  obtains  from  Proposition  14 
for  this  choice  is  v e 3 o y ) (x)  if  and  only  if 
< x,v>  = Yc(x)  • yco (v)  = 1. 

Example  2.  Take  v (o)  = o for  0 <_  a <_  1 and  >p(o)  = 1 for 
1 <_  a < +“  . Then  v?+  = <p  - 1.  Here  the  "utility"  function  <p  ° yc 
increases  linearly  as  x moves  from  the  origin  towards  C and  becomes 
constant  once  x gets  inside  C. 

2 1 
Example  3.  Take  (o)  = o - a / 2 for  0 <_  a <_  1 and  (0)  - j 

for  1 <_  0 < + “ . Then  v+  = v5  -i.  Here  the  "utility"  function  o yc 

increases  quadratically  as  x moves  from  the  origin  towards  C and 

becomes  constant  once  x is  inside  C. 
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8.  Concluding  comments. 


We  wish  to  emphasize  the  open-ended  nature 
of  the  present  framework.  For  each  of  our  model  problem's  elements  - the 
cones  P and  Q,  the  functions  h and  k,  and  the  transformation  A - 
there  are,  of  course,  many  specific,  basic  structural  forms  of  potential 
interest  and  importance.  When  one  contemplates  further  to  consider  inter- 
mingling these  various  structural  forms,  the  possibilities  become  virtually 
endless.  In  view  of  this,  we  have  chosen  in  this  paper  to  concentrate 
on  developing  a general  framework  (§§3,4, 5, 6)  broad  and  versatile  enough 
to  encompass  a variety  of  specific  problem  types  of  known  value,  and 
secondarily  to  indicate  (§7)  the  essential  facts  necessary  for  applying 
the  framework  in  the  broad  cases  of  convex  "distance"  and/or  concave 
"utility"  structure  in  h and  k. 

Note,  too,  that  our  entire  approach  has  in  effect  been  based  on  a 
simple  but  very  general  "symmetry  principle"  (§3).  This  principle  might 
be  kept  in  mind  as  a potentially  powerful  conceptual  aid  in  deciding  how 
to  formulate  a class  of  problems  initially  so  as  to  achieve  various 
desirable  duality  effects . 

We  close  by  mentioning  a few  of  the  other  possibilities  which  might 
be  combined  fruitfully  with  the  present  framework. 

First,  altering  h or  k by  affine  or  "conjugate  affine"  terms  does 
not  materially  alter  the  framework.  It  simply  lias  the  effect  of  removing 
the  normalizations  (wi th  respect  to  the  origins)  which  we  imposed  for 
purely  notational  convenience.  See  [18,  Theorem  12.3]. 

Second,  additive  separability  in  h or  k and  A is  a powerful 
feature,  on  which  decomposition  into  smaller  subproblems  might  be  based. 

See  [8]  for  an  illustration  of  how  the  decomposition  principle  can  be 
formulated  in  the  context  of  Fenchel-Rockaf el lar  duality.  Quasi-separability 
could  also  be  useful,  particularly  in  conjunction  with  faithful  convexity. 
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See  [19],  where  both  these  notions  are  defined  and  studied  in  the  context 
of  finitely  many  convex  inequality  constraints. 

Third,  structure  present  in  the  cones  P and  0 might  be  exploited. 
Finitely  generated  or  polyhedral  cones  would  admit  sharpenings  of  some 

results  (by  Proposition  8(f),  for  example).  Intersection  or  finite  sum 

* 

structure  could  also  be  useful,  at  least  insofar  as  computing  P and  Q 
Finally,  the  type  of  transformation  A treated  in  the  model  can  be 
broadened  considerably  with  the  aid  of  slightly  stronger  assumptions.  In 
[10]  it  is  shown  how  the  present  model  extends  quite  naturally  to  handle 
A ' s which  are  closed  convex  processes  (see  [18,  §39)  for  the  definition) 
In  particular,  densely  defined  single-valued  linear  A's  having  closed 
graph  are  covered  there. 
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